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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . |EI This communication is responsive to the amendment filed on Feb. 10, 2010. 

2. The allowed claim(s) is/are 1-6.9-17.19-23 and 25-31 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 
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attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . □ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. ^ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 



/Jeremiah C Huber/ 
Examiner, Art Unit 2621 



/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621 



Notice of Allowability 



Part of Paper No./Mail Date 20100507 



Application/Control Number: 10/816,051 Page 2 

Art Unit: 2621 

EXAMINER'S AMENDMENT 

An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
and accompanying emails with Joseph Sosinksi on 5/7/2010. 

The application has been amended as follows: 
1 . A mot i on difference vector estimation method comprising: 

identifying, by a computer, one or more pixels in a first frame of a multi-view 
video sequence; 

constraining a search range associated with a second frame of the said multi- 
view video sequence to a first area vertically centered on an epipolar line in the second 
frame, wherein the said epipolar line corresponds to the said one or more pixels in the 
first frame, the first area is defined by a having a vertical height specified by a first 
correlation between efficient compression and semantic accuracy received by the 
computer from a user, wherein the said vertical height increases if the first correlation is 
weighted toward efficient compression and the said vertical height decreases if the first 
correlation is weighted toward semantic accuracy, and th e wherein semantic accuracy 
relies on use of geometric configurations of cameras capturing the multi-view video 
sequence, wherein the vertical direction is defined as the direction perpendicular to said 
epipolar line, and wherein the said search range is further constrained using a disparity 
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vector computed for the said one or more pixels in the first frame and wherein the 
constrained search range is repositioned relative to the said epipolar line using the said 
disparity vector in addition to constraining the said vertical height using the first 
correlation; 

searching the second frame within the said constrained search range for a match 
of the said one or more pixels identified in the first frame for subsequent use in 
computing a difference vector for the said one or more pixels in the first frame , the said 
difference vector to be transmitted as part of a compressed representation of the first 
frame; 

receiving a second correlation between efficient compression and semantic 
accuracy from the user; and 

searching a third frame within a search range constrained by a second 
correlation between efficient compression and semantic accuracy, the second 
correlation specified by the user and a value of the second correlation is different from a 
value of the first correlation. 

12. A non-transitory computer readable memory medium that provides computer 
program instructions, which when executed on a computer processor cause the 
processor to perform operations comprising: 

identifying one or more pixels in a first frame of a multi-view video sequence; 

constraining a search range associated with a second frame of the multi-view 
video sequence to a first area vertically centered on an epipolar line in the second 



Application/Control Number: 10/816,051 Page 4 

Art Unit: 2621 

frame, wherein toe said epipolar line corresponds to the one or more pixels in the first 
frame, the first area is defined by a having a vertical height specified by a first 
correlation between efficient compression and semantic accuracy received from a user, 
wherein the said vertical height increases if the first correlation is weighted toward 
efficient compression and the said vertical height decreases if the first correlation is 
weighted toward semantic accuracy, and-the wherein semantic accuracy relies on use 
of geometric configurations of cameras capturing the multi-view video sequence, 
wherein the vertical dimension is defined as the direction perpendicular to said epipolar 
line and wherein the said search range is further constrained using a disparity vector 
computed for the said one or more pixels of the first frame and wherein the said 
constrained search range is repositioned relative to the said epipolar line using the said 
disparity vector in addition to constraining the said vertical height using the first 
correlation; 

searching the second frame within the said constrained search range for a match 
of the said one or more pixels identified in the first frame for subsequent use in 
computing a difference vector for the one or more pixels, the said difference vector to be 
transmitted as part of a compressed representation of the first frame; 

receiving a second correlation between efficient compression and semantic 
accuracy from the user; and 

searching a third frame within a search range constrained by a second 
correlation between efficient compression and semantic accuracy, the second 
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correlation specified by the user and a value of the second correlation is different from a 
value of the first correlation. 

20. A computerized system comprising: 
a memory; and 

at least one processor coupled to the memory, the at least one processor 
executing a set of instructions which cause the at least one processor to 

identify one or more pixels in a first frame of a multi-view video sequence, 
constrain a search range associated with a second frame of the multi-view video 
sequence to a first area vertically centered on an epipolar line in the second frame, 
wherein the said epipolar line corresponds to the said one or more pixels in the first 
frame, the first area is defined by a having a vertical height specified by a first 
correlation between efficient compression and semantic accuracy received from a user, 
wherein the said vertical height increases if the first correlation is weighted toward 
efficient compression and the said vertical height decreases if the first correlation is 
weighted toward semantic accuracy, and the wherein semantic accuracy relies on use 
of geometric configurations of cameras capturing the multi-view video sequence, 
wherein the vertical dimension is defined as the direction perpendicular to said epipolar 
line, and wherein the said search range is further constrained using a disparity vector 
computed for the said one or more pixels in the first frame and wherein the said 
constrained search range is repositioned relative to the said epipolar line using the said 



Application/Control Number: 10/816,051 Page 6 

Art Unit: 2621 

disparity vector in addition to constraining the said vertical height using the first 
correlation, 

search the second frame within the said constrained search range for a match of 
the said one or more pixels identified in the first frame for subsequent use in computing 
a difference vector for the said one or more pixels in the first frame , the said difference 
vector to be transmitted as part of a compressed representation of the first frame, 

receive a second correlation between efficient and semantic accuracy from the 
user, and 

search a third frame within a search range constrained by a second correlation 
between efficient compression and semantic accuracy, the second correlation specified 
by the user and the second correlation different from the first correlation. 

26. A mot i on difference vector estimation apparatus comprising: 

a block identifier to identify one or more pixels in a first frame of a multi-view 
video sequence; 

a search range determinator to constrain a search range associated with a 
second frame of the multi-view video sequence to a first area vertically centered on an 
epipolar line in the second frame, wherein the said epipolar line corresponds to the said 
one or more pixels in the first frame, the first area is defined by a having a vertical 
height specified by a first correlation between efficient compression and semantic 
accuracy received from a user, wherein the said vertical height increases if the first 
correlation is weighted toward efficient compression and the said vertical height 
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decreases if the first correlation is weighted toward semantic accuracy, and th e wherein 
semantic accuracy relies on use of geometric configurations of cameras capturing the 
multi-view video sequence, wherein the vertical direction is defined as the direction 
perpendicular to the epipolar line wherein the said search range determinator is 
configured to further constrain the search range using a disparity vector computed for 
the said one or more pixels in the first frame and wherein the said constrained search 
range is repositioned relative the said epipolar line using the said disparity vector in 
addition to constraining the said vertical height using the first correlation; and 

a searcher to search the second image within the said constrained search range 
for a match of the said one or more pixels identified in the first frame for use by a 
difference vector calculator to compute a difference vector for the one or more pixels, 
the said difference vector to be transmitted as part of a compressed representation of 
the first frame, and to search a third image within a search range constrained by a 
second correlation between efficient compression and semantic accuracy, the second 
correlation received from the user and different from the first correlation. 

Allowable Subject Matter 

Claims 1-6, 9-17, 19-23 and 25-31 allowed. 
The following is an examiner's statement of reasons for allowance: 
Independent claims 1, 12, 20 and 26 relate to estimating difference, or disparity, 
vectors in a multi-view sequence. The claims require a search range in a second frame 
that is constrained to be centered on an epipolar line corresponding to selected pixels in 
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the first frame. The height of that search range is determined subject to constraints and 
a user inputted parameter that specifies a tradeoff between efficiency in compression 
and accuracy of the vector. The height being greater when efficient compression is 
desired and lower when higher accuracy desired. Wherein the vertical dimension and 
height are in the direction perpendicular to the epipolar line. 

The closest art is Sohn in view of Carlbom and in further view of Guo and 
Hamani. Which discloses a video compression method in which a disparity search is 
performed in a search window in the second centered on a position co-located to 
selected pixels in the first frame. The prior art further discloses that epipolar constraints 
may be used to reduce the number of search candidates and that the search range may 
be varied in order to implement more efficient compression. However, the prior art 
techniques teach that a smaller search window leads to more efficient compression by 
reducing computation time. Further, the prior art does not disclose orienting the search 
range so as to be varied in height relative to an epipolar line. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JEREMAIAH C. HUBER whose telephone number is 
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(571)272-5248. The examiner can normally be reached on Mon-Fri 8:00 a.m. - 4:30 
p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571)272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Jeremiah C Huber 

Examiner 

Art Unit 2621 

/Jeremiah C Huber/ 
Examiner, Art Unit 2621 

/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621 



